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IMAGE DECODING APPARATUS-r AND IMAGE DECODING METHOD 



FOR DECODING IMAGE DATA INCLUDING PLURAL 



IMAGE SEQUENCES, AND PROGRAM STORAGE MEDIUM 



5 FIELD OF THE INVENTION 

I; 

The present invention relates to an image decoding 
apparatus, an image decoding method, and a program storage medium- 
and, more . More particularly, the present invention relates to 
an image decoding process in which image data corresponding to 
10 plural image sequences can be decoded with a single decoder. 
BACKGROUND OF THE INVENTION 

Figure 11(a) is a diagram for explaining a conventional 
image decoding apparatus 50. 



15 corresponding to a single image sequence. The image decoding 

apparatus 50 includes a decoder 51 and a memory 52. The decoder 
51 receives, for example, a video stream based on a standard such 
as MPEG2 (Moving Picture Experts Group Phase 2) as image data Sb, 
decodes the image data for each frame, and outputs decoded image 

2) data Db. The memory 52 stores the decoded image data of the 

already decoded frames, as reference image data Dr to be referred 
to in the decoding process. 

In the image decoding apparatus 50, decoding of the 
inputted coded image data Sb is carried out with reference to the 

25 reference image data Dr which is stored in the memory 52, and the 



This image decoding apparatus 50 decodes coded image data 
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decoded image data Db obtained in the decoding process is 
outputted. The decoded image data Db corresponding to the target 
frame is stored in the memory 52 as the reference image data Dr 
for the frames subsequent to Lhe target frame. 
5 In the conventional image decoding apparatus 50 constructed 

as described above, however, image data which can be decoded 
simultaneously are limited to those corresponding to a single 
image sequence. Therefore, the conventional apparatus 50 cannot 
perform parallel decoding of image data corresponding to plural 
10 image sequences, for example, image data corresponding to plural 
objects (image sequences) which exist in one frame as shown in 
figure 13 (in figure 13, four objects Ob0^-Ob3) . 

^ Thus , there has been proposed a construction of an image 
decoding apparatus 110 shown in figure 11(b), which can perform 
15 parallel decoding of image data corresponding to plural image 
sequences (objects) as shown in figure 13. 

The image decoding apparatus 110 shown in figure 11(b) 
receives a video stream which includes coded image data Sb0^-^b3 
shown in figure 14(a) corresponding to the four image sequences 
23 Ob0^-Ob3 shown in figure 13, respectively, for example, a video 
stream Vs in which the coded image data Sb0^-Sb3 are multiplexed 
as shown in figure 14 (b) , and decodes the coded image data Sb of 
the respective image sequences in parallel with each other. 
Although the respective coded image data are multiplexed in 
25 regular arrangements in the video stream Vs shown in figure 14(b), 
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there are cases, depending on the multiplexing method, where the 
respective coded image data are randomly arranged according to 
the frame rates or the like of the respective coded data. 

That is, the image decoding apparatus 110 include3_^ 
decoders 112a^^ll2d for decoding the respective coded image data 
Sb0^-Sb3 corresponding to the four image sequences, and 
outputting decoded image data Db0^-Db3 corresponding to the 
respective image sequences; and memories 113a^-113b for holding 
reference image data Dr0^-Dr3 which are to be referred to when 
10 the respective image sequences are decoded. 

Further, the image decoding apparatus 110 includesj_ an 
input-side switch 111 for supplying the inputted video stream Vs 

to one of the four decoders 112a^~112d on the basis of image 
sequence identifying information Id for identifying an image 
15 sequence; and an output-side switch 114 for selecting one of the 
decoded image data DbO-^2^b3 outputted from the four decoders 
112a^j2ll2d, and outputting the selected decoded image data Db as 
reproduced image data EDb. 

The input-side switch 111 has an input terminal 111a to 
2D which the video stream Vs is applied, and output terminals lllbO 
^2mt>3 for outputting the coded image data Sb0^-Sb3 to the 
corresponding decoders 112a^-^^^^~f — cind the . The input-side 
switch 111 connects the input terminal 111a to one of the output 
terminals Illb0^-lllb3 which corresponds to the image sequence 
25 indicated by the image sequence identifying information Id. The 
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output-side switch 114 has input terminals 114aO^-H^^3 to which 
the decoded image data DbO^^^^^^ outputted from the respective 
decoders 112a^-112d are applied, and an output terminal 114b for 
outputting the reproduced image data Euh-, — and the . The output= 
5 side switch 114 connects the output terminal 114b to one of the 
input terminals 114a0^^114a3 which corresponds to the image 
sequence indicated by the image sequence identifying information 
Id. 

Next, the operation of the conventional image decoding 

ID apparatus 110 constructed as described above will be described. 

When the video decoding apparatus 110 receives the video 
stream Vs including the image data SbO^^^bS of the four image 
sequences, and the image sequence identifying information Id for 
identifying image data in the video strea m Vs , the input-side 

15 switch 111 connects the input terminal Ilia to which the video 
stream Vs is applied, to a desired output terminal of the input 
side switch 111 on the basis of the image sequence identifying 
information Id. For example, when the coded image data SbO 
corresponding to the first image sequence is inputted as the 

2) video stream Vs, the image sequence identifying information Id 
indicates that the video stream Vs is the coded image data SbO 
corresponding to the first image sequence ObO . Thereby, in the 
input-side switch 111, the input terminal 111a is connected to 
the first output terminal lllbO on the basis of the image 

25 sequence identifying information Id, and the coded image data SbO 
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is supplied to the first decoder 112a corresponding to the first 
output terminal 1 1 IbO . 

fi^rst decoder 112a, decoding of the coded image data 
SbO is carried out with reference to the reference image data DrO 
that is stored in the first memory 113a, and the decoded image 
data DbO obtained in the decoding process is outputted to the 
first input terminal 114a0 of the output-side switch 114. 

Then, in the output-side switch 114, the output terminal 
114b is connected to the first input terminal 114aO on the basis 
10 of the image sequence identifying information Id, and the decoded 
image data DbO from the first decoder 112a is outputted as the 
reproduced image data EDb. 

When the coded image data Sbl, Sb2, or Sb3 corresponding to 
the second, third, or fourth image sequence is inputted as the 
15 video stream Vs, in the same manner as described above, the 

input-side switch 111 changes the connecting state between the 
input terminal and the output terminal thereof according to the 
image sequence identifying information Id so that the inputted 
coded image data Sb is supplied to the corresponding decoder 112, 
20 and the output-side switch 114 changes the connecting state 
between the input terminal and the output terminal thereof so 
that the decoded image data Db from the decoder 112 corresponding 
to the image sequence indicated by the image sequence identifying 
information Id is outputted as the reproduced image data EDb. As 
25 the result, decoding of the coded image data Sb corresponding to 
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the image sequence indicated by the image sequence identifying 
information Id is carried out. 

In the image decoding apparatus 110 which can decode the 
plural coded image data 3b in parallel with each other, as shown 
in figure 11 (b) , the independent decoders llZa^^^H^b are 
required for the respective image data to be processed in 
parallel, and a decoder 112 to be used should be selected 
according to an image sequence which corresponds to the inputted 
video stream Vs. However, this leads to drawbacks such as a__ 
10 complicated construction of the image decoding apparatus, an 
increased size of the image decoding apparatus and, further, 
increased costs due to the complicated and large-sized 
construction . 

Further, in the method of performing parallel decoding on 
15 plural image data by using a number decoders as many as the 
number of the image sequences to be decoded, the number of 
decoders corresponding to the image sequences to be decoded must 
be decided in advance. 

Furthermore, Japanese Published Patent Application No. 
2D Hei. 9-093577 discloses an image decoding apparatus which is 
constructed to perform time division decoding on image data 
corresponding to plural image sequences by using a single decoder 
Hereinafter, the image decoding apparatus disclosed in this 
literature will be briefly described. 
25 Figure 12 is a block diagram for explaining the this image 
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decoding apparatus . 

The image decoding apparatus 200 comprises a decoder 200a 
and a memory 200b. The decoder 200a performs time division 
decoding on image data corresponding to plural (four in this 
5 case) image sequences, on the basis of a video stream Vs 
including the image data corresponding to the four image 
sequences, and image sequence identifying information Id for 
identifying each image sequence. The memory 200b stores 
reference image data Dr to be referred to when the decoding is 
10 carried out. 

The decoder 200a includes dedicated registers 211^-214, 
parameter selectors 221^^224, a register selector 230, and a 
decoding unit 240. The dedicated registers ' 211^2214 correspond 
to the respective image sequences, and each register stores 
15 decoding data which comprises data (parameter data) Dp indicating 
plural parameters 0^-^ that are used for decoding. The 
parameter selectors 221^-224 corresponds to the respective 
dedicated registers 211^2:214, and each parameter selector 
selects a storage position for each parameter in the 
20 corresponding register, on the basis of parameter storage 

position information Ip indicating the types of the parameters. 
The register selector 230 selects one of the parameter selectors 
221^^224 on the basis of the image sequence identifying 
information Id, thereby selecting one of the dedicated registers 
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211^-214. The decoding unit 240 decodes the video stream Vs, on 
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the basis of the decoding information including the parameter 
data Dp stored in each register, with reference to the reference 
image data Dr stored in the memory 200b, and outputs decoded 
image data Db obtained by the decoding process. 
5 The decoding unit 240 extracts the parameter data Dp 

(decoding information) corresponding to each frame in each image 
sequence on the basis of header information included in the video 
stream Vs, and outputs the parameter data Dp to the register 
selector 230 and, simultaneously, outputs parameter storage 
10 position information Ip indicating the type of the parameter to 
the respective parameter selectors 221^-224. 

In the dedicated registers 211^-214, the respective 
parameter data Dp indicating the parameters 0^-N are stored in 
the parameter storage positions RO^-Rn corresponding to the 
15 respective parameters. Further, the register selector 230 has a 
first terminal 235 for accessing each dedicated register which 
stores the decoding information of each image sequence, and 
plural second terminals 231^-234 corresponding to the respective 
dedicated registers 221^-224, for accessing the parameter data 
20 Dp stored in the respective registers 211^-214. The register 

selector 230 connects the first terminal 235 to any of the second 

terminals 2 31^-234 according to the image sequence identifying 
information Id . 

Further, the parameter selector 221 has a first terminal b 
25 connected to the second terminal 231 of the register selector 230, 
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and second terminals aO^-an for accessing the parameter data Dp 
stored in the respective parameter storage positions RO^-^n of 
the register 211. The parameter selector 222 has a first 
terminal b connected to the second terminal 232 of the register 
selector 230, and second terminals aO^-an for accessing the 
parameter data Dp stored in the respective parameter storage 
positions RO^j^^n of the register 212. Likewise, the parameter 
selector 223 has a first terminal b connected to the second 
terminal 233 of the register selector 230, and second terminals 
ID aO^-an for accessing the parameter data Dp stored in the 

respective parameter storage positions RO^-^n of the register 
213. The parameter selector 224 has a first terminal b connected 
to the second terminal 234 of the register selector 230, and 
second terminals aO^-an for accessing the parameter data Dp 
15 stored in the respective parameter storage positions RO-^^Rn of 
the register 214. 

Next, a description will be given of the operation of the 
image decoding apparatus 2 00 constructed as described above. 

When the video stream Vs and the image sequence identifying 
2D information Id are inputted to the image decoding apparatus 200, 
the video stream Vs is analyzed by the decoding unit 240, whereby 
the parameter data Dp_^ as decoding information corresponding to a 
predetermined image oGqucncc sequence, is extracted from the video 
stream Vs and outputted to the register selector 230. Further, 
25 the parameter storage position information Ip indicating the type 
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of each parameter data Dp which is extracted as decoding 
information from the video stream Vs is sequentially outputted to 
the respective parameter selectors 221^2224. 

In the register selector 230, on the basis of the image 

5 sequence identifying information Id, the parameter data Dp from 
the decoding unit 240 is outputted to a desired parameter 
selector, for example, the parameter selector 221. In the 
parameter selector 221, on the basis of the parameter storage 
position information Ip outputted from the decoding unit 240, the 

10 respective parameter data Dp as decoding information from the 
register selector 230 are sequentially stored in the 
corresponding parameter storage positions in the exclusive 
register 211. To be specific, the parameter data Dp 
corresponding to the parameters 0, 1, N are stored in the 

15 parameter storage positions RO, Rl, Rn in the register 211, 

respectively. 

In the decoding unit 240, on the basis of the parameter 
data Dp as decoding information stored in the register 211, 
decoding is performed on the video stream Vs corresponding to a 

2D target frame of a predetermined image sequence, with reference to 
the reference image data Dr stored in the memory 200b. When this 
decoding is completed, image data corresponding to the already 
processed frame is stored in the memory 200b as reference image 
data Dr to be referred to when decoding the following frames. 

25 Further, when the video stream Vs corresponding to another 
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image sequence is inputted, the parameter data Dp as decoding 
information is stored in the register corresponding to the image 
sequence and, thereafter, decoding is performed on the video 
stream Vs corresponding to this image sequence, on the basis of 
5 the parameter data Dp stored in the register. 

As described above, in the image decoding apparatus 200 
shown in figure 12, the decoder 200a is provided with the 
dedicated registers (decoding information storage registers) for 
storing decoding information, which number as many as the number 
ID of image sequences that are to be decoded. Therefore, it is 
possible to decode the video stream Vs including plural image 
sequences by using one decoder. However, although the image 
decoding apparatus 200 can perform parallel decoding of the 
plural image sequences included in the video stream Vs by using 
15 one decoder 200a, the decoder 200a should be provided with the 
decoding information storage registers which number as many as 
the number of image sequences that are to be processed. 

As described above, in the conventional image decoding 
apparatus, in order to perform parallel decoding on image data of 
2) plural image sequences, it is necessary to prepare decoders which 
number as many as the number of the image sequences to be 
processed simultaneously, or it is necessary to provide a decoder 
having decoding information storage registers which number as 
many as the number of the image sequences to be processed 
25 simultaneously. In other words, in the conventional image 
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decoding apparatus^ the number of image sequences to be processed 
simultaneously must be known in advance. 

Accordingly, when the number of image sequences to be 
processed simultaneously is changed, the construction of the 

5 decoder must be reviewed or the decoder must be redesigned 

according to the change. This causes an increase in the cost of 
the image decoding apparatus . 

Furthermore, when the image decoding apparatus is provided 
with decoders which number as many as the number of image 

10 sequences that are to be processed simultaneously, the 

construction of the apparatus is complicated, and the size of the 
apparatus is increased . 

Moreover, among MPEG schemes as international standards 
relating to image data compression techniques, in MPEG4 by which 

15 coded image data of plural image sequences are handled 

simultaneously, coded image data corresponding to plural objects 
(image sequences) as shown in figure 14 are decoded and 
composited to obtain reproduced data corresponding to a composite 
image shown in figure 13, and the composite image is displayed. 

2) Accordingly, in the coding scheme based on MPEG4, image data 
corresponding to plural objects (image sequences) constituting 
one scene are multiplexed by packets to be transmitted as a 
single bit stream. In order to handle such bit stream, parallel 
decoding of the image data corresponding to the plural image 

25 sequences is required. 
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Accordingly, in the future, as an image decoding apparatus 
for simultaneously performing parallel decoding processes on 
image data of plural image sequences, a simple and inexpensive 
apparatus which can easily cope with a change in the number of 
5 image sequences to be handled simultaneously will be increasingly 
demanded . 

SUMMARY OF THE INVENTION 

The present invention is made to solve the above-described 
problems and hoG for its . Accordingly, an object of the present 
10 invention is to provide an image decoding apparatus and an image 
decoding method, which can perform decoding on image data of 
plural image sequences by using a single decoder, and which can 
code with an increase in the number of image sequences to be 
handled simultaneously by a simple change in construction. 
15 It is another object of the present invention to provide a 

program storage medium which contains a program for implementing 
the image decoding method by software. 

Other objects and advantages of the invention will become 
more apparent from the following detailed description that 
20 follows . The detailed description and specific embodiments 

described herein are provided only for illustration since various 
additions and modifications within the scope of the present 
invention will be apparent to those of gjcill skilled in the art 
from the detailed description. 
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According to a first aspect of the present invention, there 
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iG provided an image decoding apparatus for decoding image data 
including plural image sequencesT — which . The imaging decoding 
apparatus of the first aspect comprises : a memory having plural 
memory regions corresponding to the respective image sequences, - 
5 and being operable to hold decoding data to be used when the 
image data of the respective image sequences are decoded; a 
memory region selection unit operable to select one of the memory 
regions in the memory, which memory region corresponds to a 
target image sequence to be decoded, on the basis of image 

ID identifying information which indicates the target image 
sequence; a decoder having a register operable to hold the 
decoding data of the target image sequence, and performing 
perform decoding on the image data of the target image sequence 
on the basis of the decoding data stored in the register; and a 

15 decoding data transfer unit operable to transfer the decoding 
data of the target image sequence between the memory region 
selected by the memory region selection unit and the register in 
the decoder. Therefore, the decoder can always refer to the 
decoding data of the target image sequence to be decoded, whereby 

20 decoding processes for the plural image sequences can be 

performed by a single decoder. Further, even when the target 
image sequence is changed, since the decoder always refers to the 
decoding data stored in the decoding data storage region in the 
register, the computational complexity relating to a computation 

25 for specifying the decoding data storage region can be reduced. 
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Moreover, since the memory regions for holding the decoding data 
of the respective image sequences are secured on the memory, even 
when the number of image sequences to be decoded is increased, it 
is possible to cope with such increase in the number of image 
sequences by allocating, on the memory, memory regions for 
holding decoding data of these image sequences, without altering 
the construction of the decoder. 

According to a second aspect of the present invention, there 
io provided an image decoding apparatus is provided for decoding 
image data including plural image sequencesT — whi eh . The image 
decoding apparatus of the second aspect comprises: a memory 
having plural individual memory regions corresponding to the 
respective image sequences, and bcing where the memory is operable 
to hold decoding data to be used when the image data of the 
respective image sequences are decoded, and where the memory has 
a temporary memory region for temporarily holding decoding data 
of a specific image sequence; a memory region selection unit 
operable to select one of the individual memory regions in the 
memory, which memory region corresponds to a target image 
sequence to be decoded, on the basis of image identifying 
information which indicates the target image sequence; a decoding 
data transfer unit operable to transfer the decoding data of the 
target image sequence— between the individual memory region 
selected by the memory region selection unit and the temporary 
memory region; and a decoder operable to perform decoding on the 



image data of the target image sequence on the basis of the 
decoding data stored in the temporary memory region. Therefore, 
as in the first aspect, decoding processes for the plural image 
sequences can be performed by a single decoder, and further, the 
computational complexity relating to a computation for specifying 
a storage region of decoding data which is required for decoding 
can be reduced. Moreover, since the memory regions for holding 
the decoding data of the respective image sequences are secured 
on the memory, even when the number of image sequences to be 
10 decoded is increased, it is possible to cope with such increase 
in the number of image sequences by allocating, on the memory, 
memory regions for holding decoding data of these image sequences, 
without altering the construction of the decoder. 

According to a third aspect of the present invention, there 
15 is provided an image decoding apparatus is provided for decoding 
image data including plural image sequencesT — which . The image 
decoding apparatus of the third aspect comprises: a memory having 
plural memory regions corresponding to the respective image 
sequences, and being operable to hold decoding data including 
20 plural parameters to be used when the image data of the 

respective image sequences are decoded; a parameter storage 
position decision unit operable to decide storage positions of 
parameters in a memory region corresponding to a target image 
sequence to be decoded, which parameters are required when the 
25 target image sequence is decoded, and which decision is carried 
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out on the basis of image identifying information which indicates 
the target image sequence; and a decoder operable to perform 
decoding on the target image sequence^ on the basis of the 
parameters stored in the parameter storage positions which are 
5 decided by the parameter storage position decision unit. When 
decoding is carried out, the required parameters are read from 
the memory region in the memory- corresponding to the target 
image sequence. Therefore, decoding processes for the plural 
image sequences can be carried out by a single decoder. 
10 Furthermore, since the parameters which are required for decoding 
are obtained by directly referring to the storage positions of 
the required parameters in the decoding data storage region in 
the memory- corresponding to the target image sequence, the 
number of decoding data memory regions allocated on the memory 
15 are equal to the number of image sequences to be decoded, whereby 
the memory area to be used can be minimized. 

According to a fourth aspect of the present invention, 
there io provided an image decoding method is provided for 
performing decoding on image data including plural image 
20 sequences, on the basis of decoding data of the respective image 
sequences , which . The image decoding method of the fourth aspect 
comprises: transferring decoding data corresponding to a target 
image sequence to be decoded, among the decoding data 
corresponding to the respective image sequences, between a memory 
25 for holding the decoding data of the respective image sequences 
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and a temporary storage for temporarily holding decoding data of 
a specific image sequence; and decoding the image data 
corresponding to the target image sequence^ with reference to the 
decoding data stored in the temporary storage. Therefore, as in 
the first aspect, decoding processes for the plural image 
sequences can be performed by a single decoderT — and further . 
Further , the computational complexity relating to a computation 
for specifying a storage region of decoding data which is 
required for decoding can be reduced. Moreover, even when the 
number of image sequences to be decoded is increased, it is 
possible to cope with such increase in the number of image 
sequences by allocating, on the memory, memory regions for 
holding decoding data of these image sequences, without altering 
the construction of the decoder. 

According to a fifth aspect of the present invention, there 
is provided an image decoding method is provided for decoding 
image data including plural image sequences-? — which . The image 
decoding method of the fifth aspect comprises: selecting decoding 
data of a target image sequence to be decoded- from decoding data 
including plural parameter data of the respective image sequences, 
which decoding data are stored in a memory and are to be used 
when the image data of the respective image sequences are 
decoded; deciding storage positions, in the memory, of parameter 
data required for decoding, among the plural parameter data 
constituting the selected decoding data; and a decoding otep of 
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decoding the image data corresponding to the target image 
sequence^ on the basis of the parameter data stored in the 
decided storage positions. Therefore, as in the third aspect, 
when decoding is carried out, the required parameters are read 
from the memory region in the memory— corresponding to the target 
image sequence. Therefore, decoding processes for the plural 
image sequences can be carried out by a single decoder. 
Furthermore, since the parameters which are required for decoding 
are obtained by directly referring to the storage positions of 
10 the required parameters in the decoding data storage region in 
the memory, corresponding to the target image sequence, the 
number of decoding data memory regions allocated on the memory 
are equal to the number of image sequences to be decoded, whereby 
the memory area to be used can be minimized. 
15 According to a sixth aspect of the present invention, there 

io provided a program storage medium containing is provided which 
contains a program for making a computer perform data processing 
on image data including plural image sequences, on the basis of 
decoding data of the respective image sequencesT — and thio . The 
20 program storage medium of the sixth aspect contains a data 

processing program which makes the computer perform the following 
processes: a decoding data transfer process of transferring 
decoding data of a target image sequence to be decoded, among the 
decoding data of the respective image sequences, between a memory 
25 for holding the decoding data of the respective image sequences 
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and a temporary storage for temporarily holding decoding data of 
a specific image sequence; and a decoding process of decoding the 
image data corresponding to the target image sequence, with 
reference to the decoding data stored in the temporary storage. 
5 Therefore, the image decoding method according to the fourth 
aspect can be realized by software. 

According to a seventh aspect of the present invention, 
thorc ig provided a program storage medium containing is provided 
which contains a program for making a computer perform data 
ID processing on image data including plural image sequencesT — and 
this . The program storage medium of the seventh aspect contains 
a data processing program which makes the computer perform the 
following processes: a decoding data selection process of 
selecting decoding data of a target image sequence to be decoded— 
15 from decoding data including plural parameter data corresponding 
to the respective image sequences, which decoding data are stored 
in a memory and are to be used when the image data of the 
respective image sequences are decoded; a parameter storage 
position decision process of deciding storage positions, in the 
20 memory, of parameter data which are required for decoding, among 
the plural parameter data constituting the selected decoding 
data; and a decoding process of decoding the image data 
corresponding to the target image sequence, on the basis of the 
parameter data stored in the storage positions which are decided 
25 in the parameter storage position decision step. Therefore, the 
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image decoding method according to the fifth aspect can be 

realized by software. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram for explaining an image 
5 decoding apparatus according to a first embodiment of the present 
invention . 

Figure 2 is a flowchart for explaining the process of 
handling decoding data, according to the first embodiment. 
Figure 3 is a block diagram for explaining an image 
10 decoding apparatus according to a modification of the first 
embodiment . 

Figure 4 is a block diagram for explaining an image 
decoding apparatus according to a second embodiment of the 
present invention . 
15 Figure 5 is a diagram for explaining memory regions in a 

first memory which is a component of the image decoding apparatus 
of the second embodiment. 

Figure 6 is a flowchart for explaining the process of 
handling decoding data, according to the second embodiment. 
20 Figure 7 is a block diagram for explaining an image 

decoding apparatus according to a third embodiment of the present 
invention . 

Figure 8 is a block diagram for explaining an image 
decoding apparatus according to a fourth embodiment of the 
25 present invention . 
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Figure 9 is a diagram illustrating the data structure of a 
bit stream which is an input signal to the image decoding 
apparatus of the third or fourth embodiment. 

Figures 10(a) and 10(b) are diagrams for explaining a 
program storage medium containing a program which permits a 
computer system to perform a decoding process according to any of 
the aforementioned embodiments, and figure Figure 10(c) is a 
diagram illustrating the computer system. 

Figure 11(a) is a block diagram for explaining a 
conventional image decoding apparatus for decoding image data 
corresponding to a single image sequence^ and Figure jrl— 11 (b) is 
a block diagram for explaining a conventional image decoding 
apparatus for decoding image data corresponding to plural image 
sequences by using plural decoders. 

Figure 12 is a block diagram for explaining a conventional 
image decoding apparatus for decoding image data corresponding to 
plural image sequences by using a single decoder. 

Figure 13 is a diagram illustrating an example of a 
displayed composite image_^ 

Figure 14(a) is a diagram illustrating coded image data of 
plural image sequences, and figure Figure 14(b) is a diagram 
illustrating a video stream in which the coded image data are 
multiplexed . 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, embodiments of the present invention will be 



described. 

[Embodiment 1] First Embodiment 

Figure 1 is a block diagram for explaining an image 
decoding apparatus 1 according to a first embodiment of the 
5 present invention. 

The image decoding apparatus 1 according to this first 
embodiment receives a video stream Vs which is obtained by 
multiplexing image data corresponding to plural image sequences, 
and image sequence identifying information Id which indicates an 
ID image sequence corresponding to each image data inputted as the 
video stream Vst — and pGrformo . The image decoding apparatus 1 
performs decoding of the image data corresponding to each image 
sequence on the basis of the image sequence identifying 
information Id. The image data is data that is obtained by 
15 coding a digital image signal corresponding to the image sequence. 
The image decoding apparatus 1 of this first embodiment is 
constructed so as to perform parallel decoding on image data 
corresponding to (m+1) image sequences included in the video 
stream Vs. The image sequence identifying information Id 
23 indicating a target image sequence to be decoded is supplied from 
a CPU (not shown) for controlling the image decoding apparatus 1 
to the image decoding apparatus 1, in synchronization with the 
video stream Vs. 

The image decoding apparatus 1 includes a decoder 10, a 
25 first memory Ma, and a second memory 14. To be specific, the 
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decoder 10 extracts parameter data Dp as decoding data of each 
image sequence from the inputted video stream Vs, and decodes 
image data of an image sequence to be decoded (target image 
sequence) , in predetermined units of data, on the basis of the 

5 decoding data Dd of the target image sequence which is specified 
by the image sequence identifying information Id of the inputted 
video stream Vs, with reference to already-decoded reference 
image data Dr as necessary, and outputs decoded image data Db 
corresponding to the target image sequence. The first memory Ma 

10 includes memory regions Ma(0), Ma(l), Ma (m) corresponding to 

the plural image sequences to be handled by the image decoding 
apparatus 1, and stores desired decoding data Dd extracted from 
each image sequence of the video stream Vs in each memory region. 
The second memory 14 holds the reference image data Dr to be 

15 referred to in the above-described decoding process. 

The image decoding apparatus 1 further includes a decoding 
data transfer unit 13 and a memory region selector 12. The 
decoding data transfer unit 13 transfers the decoding data Dd 
corresponding to the target image sequence of the video stream Vs, 

20 between the first memory Ma and the decoder 10, on the basis of a 
timing signal It supplied from the decoder 10 and the image 
sequence identifying information Id. The memory region selector 
12 is placed between the decoding data transfer unit 13 and the 
first memory Ma, and the memory region selector 12 connects the 

25 decoding data transfer unit 13 to one of the plural memory 
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regions Ma(0)^-Ma(m) in the first memory Ma, on the basis of the 
image sequence identifying information Id. 

Assuming that the (m+1) image sequences included in the 
video stream Vs are image sequences ObO^-Obm.. respectively, the 
memory regions Ma(0)^2^a(m) in the first memory Ma correspond to 
the image sequences ObO^^^bm, and decoding data DdO, Ddl, 
Ddm corresponding to the (m+1) image sequences are stored in the 
memory regions Ma (0)^;2^a (m) , respectively. 

As described above, each decoding data Dd comprises data Dp 
10 of (N+1) parameters 0^-^, and the (N+1) pieces of parameter data 
Dp are stored in parameter storage positions RO^-Rn 
corresponding to the (N+1) parameters in each of the memory 
regions Ma ( 0 ) ^^^a (m) . As an initial value to be stored in each 
of the parameter storage positions RO^-Rn, a predetermined value, 
15 for example, a value depending on the coding method (MPEG2, MPEG4, 
or the like) or a value which is set as the operation of the 
whole image decoding apparatus (i.e., a value for setting the 
initial state of the image decoding apparatus), is given. 
Further, continuous addresses in an address area of the first 
20 memory Ma are set in the parameter storage positions RO^-Rn. 

In the respective memory regions Ma(0)^^Ma(m) in the first 
memory Ma, the same kind of parameters are stored in the 

parameter storage positions RO^-^n whose relative positions from 
the head positions of the respective memory regions are identical. 
25 Further, the (N+l) pieces of parameter data Dp constituting each 
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decoding data Dd are, for example, header information which 
corresponds to a data unit higher than a macroblock layer and 
indicates the width and height of a frame corresponding to the 
image data, the coding method for the image data, quantization 
5 parameters in the coding process of the image data, and the like; 
information indicating the storage position of the reference 
image data Dr which is stored in the second memory 14; and the 
like . 

Further, the memory region selector 12 has a first terminal 
10 12a for accessing the docodG decoding data Dd between itself and 
the decoding data transfer unit 13, and second terminals 12b0, 
12bl, 12bm connected to the decoding data storage regions 

(memory regions) Ma(0), Ma(l), Ma(n) corresponding to the 

respective image sequences in the first memory Ma. The selector 
15 12 connects the first terminal 12a to any of the second terminals 

12b0^-12bm on the basis of the image sequence identifying 
information Id. 

Further, the decoding data transfer unit 13 transfers the 
decoding data Dd which is stored in a desired memory region in 
20 the first memory Ma, to the decoder 10, on the basis of the image 
sequence identifying information Id. Furthcr ln addition , the 
transfer unit 13 transfers the decoding data Dd which is 
extracted from each image sequence of the video stream Vs and 
then stored by the decoder 10, to a memory region in the first 
25 memory Ma corresponding to the image sequence, on the basis of a 
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timing signal It output ted from the decoder 10. 

The decoder 10 includes a decoding unit 103, and a decoding 
data storage register 101. The decoding unit 103 analyzes the 
header information of the inputted video stream Vs to extract 
5 parameter data Dp corresponding to a target image sequence to be 
decoded, and generates parameter storage position information Ip 
identifying the extracted parameter data Dp. The decoding data 
storage register 101 holds decoding data Dd corresponding to the 
target image sequence, which data may be required in the decoding 
10 process by the decoding unit 103. Parameter storage positions RO 
^-Rn corresponding to parameter data Dp of (N+1) parameters 0^-N 
constituting the decoding data Dd are set in the decoding data 
storage register 101, and the corresponding data Dp of the 
parameters 0^-N are stored in the parameter storage positions RO 
15 -^-Rn, respectively. The decoding unit 103 performs decoding on 
the inputted video stream Vs, on the basis of the decoding data 
Dd extracted from the video stream Vs and the decoding data Dd 
supplied from the first memory Ma, thereby generating the decoded 
image data Db. 

20 Furthermore, the decoder 10 includes a parameter selector 

102 placed between the decoding unit 103 and the decoding data 
storage register 101. The parameter selector 102 has a second 
terminal 102b for accessing parameter data Dp between itself and 
the decoding unit 103, and plural first terminals 102a0^-102an 
25 corresponding to the respective parameter storage positions RO^- 
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Rn of the decoding data storage register 101. The parameter 
selector 102 connects the second terminal 102b to one of the 
first terminals 102a0^2l02an7 — of the parameter selector 102 on 
the basis of the parameter storage position information Ip 
5 supplied from the decoding unit 103. 

Hereinafter, a description will be given of the operation 
of the image decoding apparatus 1 according to the first 
embodiment of the present invention . 

Figure 2 is a flowchart for explaining the operation of the 

10 image decoding apparatus 1 . 

Initially, when a video stream Vs obtained by multiplexing 
image data corresponding to plural image sequences is inputted, 
in predetermined units of data, to the image decoding apparatus 1, 
the image decoding apparatus 1 performs decoding on the video 

15 stream Vs, in the above-mentioned units of data, on the basis of 
the video stream Vs and the image sequence identifying 
information Id which is inputted in synchronization with the 
video stream Vs. In this first embodiment, the predetermined 
units of data by which the video stream Vs is inputted are, for 

20 example, frames, and hereinafter, the units of data are sometimes 
referred to as frames . 

To be specific, in the memory region selector 12, the first 
terminal 12a on the decoding data transfer unit 13 side is 
connected to any of the second terminals 12b0^-12bm on the 

25 plural memory regions side in the first memory Ma, on the basis 
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of the image sequence identifying information Id indicating an 
image sequence corresponding to the inputted video stream Vs. 
Then, the decoding data transfer unit 13 transfers the decoding 
data Dd in a predetermined raemory region in the first memory Ma, 

5 which memory region is selected by the memory region selector 12, 
to the decoding data storage register 101 in the decoder 10, on 
the basis of the image sequence identifying information Id. For 
example, when the inputted video stream Vs corresponds to the 
image sequence Ob(0), the decoding data DdO stored in the memory 

10 region Ma(0) in the first memory Ma is transferred to the 

decoding data storage register 101 in the decoder 10. When the 
video stream Vs inputted to the image decoding apparatus 1 
corresponds to the head frame of the image sequence Ob(0), the 
initial value of the decoding data DdO, which has previously been 

15 stored in the memory region Ma(0), is transferred to the decoding 
data storage register 101. 

On the other hand, when the image data corresponding to the 
predetermined image sequence is inputted as the video stream Vs 
to the decoder 10 (step SI), the decoding unit 103 in the decoder 

20 10 analyzes the header of the image sequence to be decoded, 

whereby the data DpO^-Dpn corresponding to plural parameters 0^- 
N (parameter data) are sequentially extracted as decoding data, 
and the parameter storage position information Ip indicating the 
kinds of the respective parameters is outputted. 

25 The number of parameter data to be extracted from the video 
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stream Vs depends on the contents of processing to be performed 
at that time, the conditions of coding to be performed on the 
inputted video stream Vs, and the like. Further, amongst the 
parameter data so extracted, the number of param.eter data Dp to 
be stored in the decoding data storage register 101 (e.g., 
parameter data to be referred to after being extracted, parameter 
data to be referred to in the following decoding process, etc.) 
is N+1 at maximum. That is, the parameter data extracted from 
the video stream Vs include some parameter data which are 
required only in the decoding process, and there is no need to 
stored these parameter data. Therefore, these parameter data are 
not stored in the decoding data storage register 101. Further, 
the reason why the number of parameter data Dp to be stored is 
N+1 at maximum is because, in the case of MPEG, there are 
parameter data which are not included in an I frame (intra-frame 
coded frame) but are included in a P frame (forward predictive 
coded frame) among the parameter data Dp to be stored. 

At this time, in the parameter selector 102, the second 
terminal 102b on the decoding unit 103 side is sequentially 
connected to a predetermined terminal selected from the first 
terminals 102a0^-102an on the decoding data storage register 101 
side, on the basis of the parameter storage position information 
Ip, and the parameter data Dp extracted from the video stream Vs 
are sequentially stored in the corresponding parameter storage 
regions RO^-Rn in the decoding data storage register 101 (step 
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S2) . 

To be specific, when a video stream Vs corresponding to an 
initial data unit (frame) of one image sequence is inputted, 
analysis of header information corresponding to the whole image 

5 sequence as well as analysis of header information corresponding 
to the data unit are carried out, and parameter data Dp 
corresponding to the whole image sequence as well as parameter 
data Dp corresponding to the data unit are extracted as decoding 
data. Further, when a video stream Vs corresponding to a second 

10 or subsequent data unit (frame) of one image sequence is inputted, 
only analysis of header information corresponding to the data 
unit is carried out, and only parameter data Dp corresponding to 
the data unit is extracted as decoding data. 

When the inputted video stream Vs is a stream which has 

15 been subjected to inter-frame predictive coding (for example, 

when jr^ the video stream Vs corresponds to a P frame or a B frame 
based on MPEG2), the decoding unit 103 decodes the video stream 
Vs, with reference to the reference image data Dr stored in the 
second memory 14, on the basis of the decoding data Dd including 

20 the (N+1) pieces parameter data Dp which are stored in the 

decoding data storage register 101. On the other hand, when the 
inputted video stream Vs is a stream which has been subjected to 
intra-frame coding (i.e., when the video stream Vs corresponds to 
an I frame) , the decoding unit 103 decodes the video stream Vs 

25 without referring to the reference image data Dr stored in the 
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second memory 14. 

After the above-described decoding processT — is completed 
the same data as the decoded image data Db obtained in the 
decoding process is stored as reference image data Dr in the 

5 second memory 14. Further, in this decoding process, amongst the 
parameter data Dp which are obtained by analyzing the header 
corresponding to the image sequence or the header corresponding 
to the data unit, those parameters to be temporarily stored 
during the decoding process corresponding to the data unit by 

10 which the video stream Vs is inputted, are also stored in the 
second memory 14. 

When the decoding of the inputted frame in the image 
sequence to be decoded (target image sequence) is completed and 
header information of the next frame is detected, a timing signal 

15 It is outputted from the decoding unit 103 to the decoding data 
transfer unit 13. Ofi— Upon receipt of the timing signal It, the 
decoding data transfer unit 13 transfers the decoding data Dd 
stored in the decoding data storage register 101 in the decoder 
10— to the memory region in the first memory Ma, which memory 

20 region corresponds to the target image sequence (step S3) . 

Thereby, with respect to the target image sequence corresponding 
to the decoded frame, the decoding data Dd in the memory region 
corresponding to the target image sequence is updated. For 
example, the respective parameter data Dp constituting the 

25 decoding data DdO corresponding to the memory region Ma(0) are 
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updated from the initial values to the values obtained in the 
decoding process. 

When a video stream Vs corresponding to the next frame is 
inputted,- the decoding data Dd stored in a desired memory region 
5 in the first memory Ma is transferred to the decoding data 

storage register 101 in the decoder 10, on the basis of the image 
sequence identifying information Id corresponding to this frame 
(step S4) . 

For example, when the video stream Vs corresponding to the 
10 second inputted frame corresponds to the image sequence Ob(l), 
the initial value which has previously been stored in the memory 
region Ma(l) in the first memory Ma is transferred as decoding 
data Ddl to the decoding data storage register 101 in the decoder 
10. On the other hand, when the video stream Vs corresponding to 
15 the second inputted frame corresponds to the image sequence Ob(0) 
like the previous frame, the most-recently updated value, which 
is stored in the memory region Ma{0) in the first memory Ma, is 
transferred as decoding data DdO to the decoding data storage 
register 101 in the decoder 10. 
23 Thereafter, the same process as that in the case where the 

video stream Vs corresponding to the first frame is inputted, is 
carried out. 

Accordingly, in the above-described decoding process, the 
respective parameter data Dp which are stored as decoding data Dd 
25 in the decoding data storage register 101 are updated every time 
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a video stream Vs corresponding to each inputted frame is decoded, 

As described above, the image decoding apparatus 1 
according to the first embodiment is provided with the decoder 10 
which includes the decoding data storage register 101 for holding 
5 decoding data Dd including parameter data Dp corresponding to a 
data unit to be decoded (target frame), and the decoder 10 
decodes a video stream Vs corresponding to the target frame on 
the basis of the decoding data Dd stored in the decoding data 
storage register IOI7— , and the first memory Ma which has the 
ID memory regions Ma(0)^-Ma(m) where the decoding data DdO^-Ddm 
corresponding to plural image sequences in the video stream Vs 
are stored. The decoding data Dd is transferred between the 
decoding data storage register 101 in the decoder 10 and a 
predetermined memory region in the first memory Ma, according to 
15 the detection that the target frame corresponds to any of the 
image sequences. Therefore, it is possible to perform parallel 
decoding on the video streams Vs corresponding to the plural 
image sequences by using the single decoder 10. Further, when 
the decoding data storage register 101 is constituted by a quick 
20 access storage such as a cache or a SRAM, the performance of the 
image decoding apparatus can be enhanced. Moreover, even when 
the number of image sequences included in the video stream Vs is 
increased, regions for storing decoding data Dd corresponding to 
the increased image sequences can be easily provided by assigning 
25 memory regions for storing the decoding data corresponding to the 
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increased image sequences within the range of the capacity of the 
first memory Ma. 

Furthermore, in the image decoding apparatus according to 
the first emJDodiment,- the plural parameter data Dp constituting 
the decoding data Dd of the target image sequence extracted from 
the video stream Vs is transferred between the decoding data 
storage register 101 in which the storage positions for the 
respective parameters are set, and the memory region in the first 
memory Ma corresponding to the target image sequence. Therefore, 
even when the target image sequence is changed during the 
decoding process in the decoding unit 103, the parameter storage 
positions in each decoding data storage region (memory region) in 
the first memory Ma are not changed, whereby the computational 
complexity relating to the parameter storage positions when the 
target image sequence is changed can be reduced. 

In the first embodiment, as long as the capacity of the 
first memory Ma is not changed, the nuinber of image sequences 
that can be the targets of decoding is restricted to the number 
of the securable storage regions (memory regions) for the 
decoding data Dd in the first memory Ma. ^Accordingly , in order 
to increase the number of the memory regions (decoding data 
storage regions) over the capacity of the first memory Ma, the 
capacity itself of the first memory Ma should be increased. 

Further, in the first embodiment, the first memory Ma for 
storing the decoding data, and the second memory 14 for storing 



the data other than the decoding data (e.g., the data to be 

temporarily stored, the reference image data Dr, and the like) 
are separated memories. However, the first and second memories 

may be implemented as a single memory. In this case, a region 

5 where the decoding data are stored and a region where the data 

other than the decoding data are stored should be allocated on 
this single memory. 

Furthermore, in the first embodiment, the memory regions 

(decoding data storage regions) Ma(0)^-Ma(m) corresponding to 

10 all of the image sequences to be decoded are allocated on the 

first memory Ma, and the decoder 10 is provided with the decoding 
data storage register (dedicated register) 101 for holding all of 
the parameter data Dp constituting the decoding data Dd 
corresponding to the target frame, and the decoding data Dd is 

15 transferred between the dedicated register and the memory regions 
in the first memory Ma. However, the constructions of the first 
memory Ma and the decoder 10 are not restricted thereto. 
+Modif ication of First Embodiment ^ 

Next, a description will be given of a modification of the 

20 first embodiment, wherein the constructions of the decoder 10, 
the first memory Ma and the like of the image decoding apparatus 
1 according to the first embodiment are altered. 

Figure 3 is a block diagram for explaining an image 
decoding apparatus la according to the modification of the first 

25 embodiment . 
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The image decoding apparatus la according to the 
modification of the first embodiment is provided with, instead of 
the first memory Ma employed in the image decoding apparatus 1 of 
the first embodiment, a first memory Mb having a data storage 
region (temporary memory region) Mb(t) wherein all parameter data 
Dp constituting decoding data Dd of a target image sequence to be 
decoded are stored, in addition to memory regions (individual 
memory regions) Mb(0)^-Mb(m) wherein decoding data Dd 
corresponding to all decodable image sequences are stored. 
Further, the image decoding apparatus la is provided with, 
instead of the decoder 10 employed in the image decoding 
apparatus 1, a decoder 10a including a register 104 for holding a 
part of the all parameter data Dp stored in the temporary memory 
region Mb(t), and a decoding unit 103 for decoding a video stream 
Vs corresponding to the target image sequence on the basis of the 
parameter data Dp stored in the register 104. 

Further, the image decoding apparatus la includes a 
parameter selector 15 for selecting one of parameter storage 
positions RO^-Rn in the temporary memory region Mb(t) on the 
basis of parameter storage position information Ip, thereby 
enabling access to the parameter data Dp between the selected 
parameter storage position and the register 104. 

The parameter selector 15 has a first terminal 15a for 
accessing the parameter data Dp between itself and the register 
104, and plural second terminals 15b0^-15bn corresponding to the 



respective parameter storage positions RO^^Rn in the temporary 
memory region Mb(t). The parameter selector 15 connects the 

first terminal 15a to one of the second terminals 15b0^-15bn on 
the basis of the parameter storage position information Ip 
outputted from the decoding unit 103. 

Other constituents of the image decoding apparatus la 
according to the modification of the first embodiment are 
identical to those of the image decoding apparatus 1 of the first 
embodiment . 

Next, a description will be given of the operation of the 
image decoding apparatus la constructed as described above. 

When a video stream Vs corresponding to a predetermined 
frame is inputted to the image decoding apparatus la, the memory 
region selector 12 selects an individual memory region in the 
first memory Mb, which region corresponds to an image sequence 
including this frame, on the basis of the image sequence 
identifying information Id. Further, the decoding data transfer 
unit 13 transfers decoding data Dd stored in the selected 
individual memory region to the temporary memory region Mb(t). 

At this time, in the decoder 10a, parameter data Dp which 
is obtained by header analysis in the decoding unit 103 is 
temporarily stored in the register 104 and, thereafter, the 
stored parameter data Dp is transferred to a predetermined 
parameter storage position (any of RO^^^n) in the temporary 
memory region Mb(t) in the first memory Mb, through the parameter 



38 



selector 15, on the basis of the parameter storage position 
information Ip. Then, decoding of the predetermined frame is 
carried out on the basis of the parameter data Dp stored in the 
register 104. In this decoding process, required parameter data 
5 Dp other than the parameter data Dp stored in the register 104 
are transferred from the temporary memory region Mb(t) to the 
register 104. 

When the decoding process is completed, the parameter data 
Dp stored in the temporary memory region Mb(t) of the first 

10 memory Mb is transferred to a decoding data storage region 

(individual memory region) in the first memory Mb, which region 
corresponds to the image sequence including the target frame, 
according to a timing signal It supplied from the decoder 10a. 
Thereafter, when a video stream Vs corresponding to the 

15 next frame is inputted, decoding data stored in an individual 
memory region corresponding to a predetermined image sequence is 
transferred to the temporary memory region Mb(t) in the first 
memory Mb on the basis of the image sequence identifying 
information Id, and the same decoding process as described above 

20 is carried out. 

The image decoding apparatus according to the first 
embodiment or the modification of the first embodiment can be 
implemented in a computer system by using software which is 
programmed so that a CPU (Central Processing Unit) performs the 

25 functions of the constituents of the image decoding apparatus. 
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such as the decoder 10 (10a), the decoding data transfer unit 13, 
the memory region selector 12, the parameter selector 15 (102), 
and the like. 

Also when the image decoding apparatus according to the 
first embodiment or the modification of the first embodiment is 
implemented by software, the same effects as obtained by the 
first embodiment or the modification of the first embodiment are 
achieved. The above-described software program can be stored in 
storage media such as a floppy disk, an optical disk, an IC card, 
a ROM cassette, etc. 
[Embodiment 2] Second Embodiment 

Figure 4 is a block diagram for explaining an image 
decoding apparatus 2 according to a second embodiment of the 
present invention . 

The image decoding apparatus 2 according to this second 
embodiment receives a video stream Vs which is obtained by 
multiplexing image data corresponding to plural image sequences, 
and image sequence identifying information Id indicating an image 
sequence corresponding to each image data inputted as the video 
stream Vst — aft d. The image decoding apparatus 2 performs decoding 
of the image data corresponding to each image sequence on the 
basis of the image sequence identifying information Id. The 
image data is obtained by encoding a digital image signal 
corresponding to the image sequence. 

The image decoding apparatus 2 according to this second 
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embodiment is constructed so as to perform parallel decoding on 
image data corresponding to (m+l) image sequences which are 
included in the video stream Vs. The image sequence identifying 
information Id which indicates a target image sequence to be 
5 decoded is supplied from a CPU (not shown) for controlling the 
image decoding apparatus 2^ to the image decoding apparatus 2, in 
synchronization with the video stream Vs. 

The image decoding apparatus 2 includes a decoder 20, a 
first memory Mc, and a second memory 14. To be specific, the 

10 decoder 2 0 extracts parameter data Dp of each image sequence from 
the inputted video stream Vs, and performs decoding on image data 
Vs of a target image sequence, in predetermined units of data, on 
the basis of decoding data Dd of the target image sequence which 
is specified by the image sequence identifying information Id of 

15 the inputted video stream Vs, with reference to already-decoded 
reference image data Dr as necessary, and outputs decoded image 
data Db corresponding to the target image sequence. The first 
memory Mc includes memory regions (data storage regions) Mc(0), 
Mc(l), Mc (m) corresponding to the respective image sequences 

20 to be handled by the image decoding apparatus 2, and stores 
desired decoding data Dd in each memory region. The second 
memory 14 stores the reference image data Dr to be referred to in 
the above-described decoding process. 

Assiaming that the (m+l) image sequences included in the 

25 video stream Vs are image sequences ObO^-Obm, respectively, the 
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memory regions Mc(0)^-^c{m) in the first memory Ma — Mc correspond 
to the image sequences ObO^-Obm, and decoding data DdO, Ddl, 
Ddm corresponding to the (m+1) image sequences are stored in the 

I 

memory regions Ma (0) ^j^^a (m) , respectively. 

Each decoding data Dd comprises data Dp of (N+1) parameters 
and the (N+1) pieces of parameter data Dp are stored in 
parameter storage positions RO^-Rn corresponding to the (N+1) 
parameters in each of the memory regions Mc ( 0)^2^c (m) . An 
initial value stored in each of the parameter storage positions 
10 R0^2^n is a predetermined value, for example, a value depending 
on the coding method (MPEG2, MPEG4, or the like) or a value which 
is set as the operation of the whole image decoding apparatus 
(i.e., a value for setting the initial state of the image 
decoding apparatus) . Further, continuous addresses in an address 
15 area of the first memory Mc are set in the parameter storage 
positions RO^-Rn. 

In the respective memory regions Mc(0)^"Mc(m) in the first 
memory Mc, the same kind of parameters are stored in the 
parameter storage positions RO^-Rn whose relative positions from 
20 the head positions of the respective memory regions are identical. 
Further, the (N+1) pieces of parameter data Dp constituting each 
decoding data Dd are, for example, header information which 
corresponds to a data unit higher than a macroblock layer and 
indicates the width and height of a frame corresponding to the 
25 image data, the coding method for the image data, quantization 
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parameters in the coding process for the image data, and the 
like; and information indicating the storage position of the 
reference image data Dr which is stored in the second memory 14; 
and the like. 

5 Further, the decoder 20 comprises a decoding unit 123, and 

a register 124. The decoding unit 123 extracts various kinds of 
parameter data Dp as decoding data corresponding to a target 
image sequence to be decoded by analyzing the header information 
of the inputted video stream Vs, and generates parameter relative 

10 storage position information Irp for discriminating between the 
parameters. The register 12 4 stores the parameter data Dp 
corresponding to the target image sequence, which parameter data 
may be required in the decoding process by the decoding unit 123. 
The register 12 4 is provided with storage units for holding 

15 several parameters, and the parameter data Dp to be required in 
the decoding process are stored in the storage units. Further, 
the decoding unit 123 performs decoding on the inputted video 
stream Vs on the basis of the parameter data Dp extracted from 
the video stream Vs and the parameter data Dp supplied from the 

20 first memory Mc, thereby generating decoded image data Db. 

Further, the image decoding apparatus 2 includes a 
parameter storage position decision unit 22, and a parameter 
storage position selection unit 23. The parameter storage 
position decision unit 22 decides the absolute storage position 

25 of the parameter data in the first memory Mc on the basis of the 
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image sequence identifying information Id corresponding to each 
image sequence and the parameter relative storage position 
information Irp supplied from the decoding unit 123 of the 
decoder 20, and outputs parameter absolute storage position 
5 information lap indicating this absolute storage position. The 
parameter storage position selection unit 23, which is placed 
between the decoder 20 and the first memory Mc, specifies any of 
the parameter storage positions RO^-Rn in the memory regions 
Mc(0)^-Mc(m) wherein the decoding data of the respective image 
10 sequences are stored, on the basis of the parameter absolute 
storage position information lap to enable access to the 
parameter data Dp between the specified parameter storage 
position and the register 124 of the decoder 20, The parameter 
storage position selection unit 23 includes a first terminal A 
for accessing the parameter data Dp between itself and the 
register 124, and second terminals BOO^-BOn, BIQ^-Bln, BmO 
•^2^mn corresponding to the respective parameter storage 
positions RO^-Rn in the decoding data storage regions (memory 
regions) Mc(0), Mc(l), Mc(m) in the first memory Mc. The 

parameter storage position selection unit 23 connects the first 
terminal A to any of the second terminals BOO^-BOn, BIO^^ 
Bin, . . . , BmO^-Bmn. 

Figure 5 is a diagram for a supplemental explanation on the 
construction of the first memory Mc. 
25 In the first memory Mc, the memory regions Mc(0)^-Mc(m) for 
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holding the decoding data corresponding to the respective image 
sequences have a predetermined data storage size S, and the 
storage positions of parameter 0 in the memory regions Mc(0), 
Mc(l), Mc(m) correspond to the head positions SA(0), 

5 SA(1), SA(m) of the respective memory regions, respectively. 

Accordingly, the following formula (1) holds. 
SA(i+l) = SA(i)+S [i: 0^^^ (m is positive integer)] ...(1) 
Next, a description will be given of the operation of the 
image decoding apparatus 2 constructed as mentioned described 
10 above . 

When a video stream Vs obtained by multiplexing image data 
corresponding to plural image sequences is inputted in 
predetermined units of data (frames) to the image decoding 
apparatus 2, decoding of the video stream Vs is performed in the 

15 above-mentioned units of data, on the basis of the video stream 
Vs and the image sequence identifying information Id which is 
inputted in synchronization with the video stream Vs. 

To be specific, in the decoding unit 123 of the decoder 20, 
analysis of the header corresponding to a target frame to be 

20 decoded is carried out on the basis of the inputted video stream 
Vs, and various kinds of parameter data Dp are sequentially 
generated as decoding data. At this time, in the decoding unit 
123, parameter data Dp is generated and, simultaneously, 
parameter relative storage position information Irp indicating 

25 the type of the generated parameter data Dp is also generated. 
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The parameter relative storage position information Irp indicates 
the storage position RP in the memory region which stores one 
decoding data of the generated parameter data Dp, relativeiy to 
the head paramei:er storage position SA. 

5 The parameter data Dp so generated is stored in the 

register 124^ and the parameter relative storage position 
information Irp is outputted to the parameter storage position 
decision unit 22. In the parameter storage position decision 
unit 22^ the absolute storage position AP of the parameter is 

ID decided on the basis of the image sequence identifying 

information Id and the parameter relative storage position 
information Irp, and parameter absolute storage position 
information lap indicating the decided absolute storage position 
is outputted to the parameter storage position selection unit 23. 

15 Then, the first terminal A of the parameter storage 

position selection unit 23 is connected to a predetermined 
terminal among the plural second terminals BOO^^^mn. Thereby, 
the parameter data Dp stored in the register 124 is transferred 
to the predetermined parameter storage position in the first 

20 memory Mc. All of the parameter data Dp extracted in the 
decoding process for one frame are stored in the parameter 
storage positions RO^-Rn in any of the decoding data storage 
regions (memory regions) Mc ( 0)-^-Mc (m) corresponding to the image 
sequence including the frame. 

25 After all of the parameter data Dp corresponding to the 
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target frame in the predetermined image sequence have been stored 
in the memory region (decoding data storage region) corresponding 
to the image sequence, the decoding unit 123 decodes the target 
frame by using the parameter data Dp stored in the mem.ory region. 

5 To be specific, when decoding the target frame, the 

parameter relative storage position information Irp indicating 
the parameter that is required for this decoding process is 
outputted from the decoding unit 123 to the parameter storage 
position decision unit 22. In the parameter storage position 

10 decision unit 22, the parameter absolute storage position AP is 
decided on the basis of the image sequence identifying 
information Id and the parameter relative storage position 
information Irp. Then, the parameter storage position selection 
unit 2 3 selects the parameter storage position AP indicated by 

15 the parameter absolute storage position information lap supplied 
from the parameter storage position decision unit 22. Thereby, 
the parameter data Dp required for decoding of the target frame 
is transferred from the first memory Mc to the register 124. 
Thereafter, in the decoding unit 123, decoding of the target 

20 frame is carried out on the basis of the parameter data Dp stored 
in the register 124, by referring to the reference image data Dr 
stored in the second memory 14 as necessary, whereby decoded 
image data Db corresponding to this frame is outputted. 

When the target frame is an I frame, decoding of this frame 

25 is carried out without referring to the reference image data Dr 
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stored in the second memory 14. 

Subsequently, when a video stream Vs of a frame 
constituting the image sequence Ob(l) is inputted, decoding data 
(plural pieces of parameter data Dp) obtained by analyzing the 
header of this video stream Vs is stored in the memory region 
Mc(l) in the first memory Mc, which region corresponds to this 
image sequence Ob(l). Then, decoding of a target frame in this 
image sequence is carried out on the basis of the parameter data 
Dp which is read from the memory region Mc(l) in the first memory 
Mc to the register 124. 

In the process of decoding a subsequent frame which is 
included in the same image sequence where the previously decoded 
frame is included, the parameter values used when the previous 
frame was decoded may be compared with the parameter values which 
are to be written now, and only the parameter data Dp whose 
values are changed may be written in the corresponding memory 
regions in the first memory Mc. 

Hereinafter, a brief description will be given of the 
operation for deciding the absolute parameter storage position AP 
in the parameter storage position decision unit 22. 

Figure 6 is a flow chart for explaining the operation of 
the parameter storage position decision unit 22. 

Initially, when the image sequence identifying information 
Id indicating a target image sequence to be decoded is inputted 
to the parameter storage position decision unit 22 (step Sll) , 



48 



I 



the parameter storage position decision unit 22 selects a target 
image sequence on the basis of the image sequence identifying 

information Id (step S12), whereby a head position SA(i) (i=0^- 
M) of a decoding data storage region (memory region) in the first 
5 memory Mc, which region corresponds to the target image sequence, 
is decided (step S13) , 

Next, when the parameter data Dp is obtained as decoding 
data in the decoding process by the decoding unit 123 of the 
decoder 20, the parameter relative storage position Irp 
10 indicating the relative storage position RP of this parameter 
data Dp is outputted to the parameter storage position decision 
unit 22 (step S14) . 

Then, in the parameter storage position decision unit 22, 
the parameter absolute storage position information lap 
15 indicating the absolute storage position AP of the parameter data 
Dp extracted by the decoding unit 123 is derived on the basis of 
the image sequence identifying information Id indicating the head 
■position SA(i) (i=0^-M) of the memory region corresponding to 
the target image sequence, and the parameter relative storage 
30 position information Irp indicating the relative storage position 
RP of the parameter data Dp. 

To be specific, the absolute storage position AP of the 
parameter data Dp in the first memory Mc is derived by adding the 
head position SA(i) (i=0^"M) of the decoding data storage region 
25 (memory region) corresponding to the target image sequence, to 
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the relative storage position RP of the parameter data Dp 
indicated by the parameter relative storage position information 
Irp supplied from the decoding unit 123. 

Then,, the parameter data Dp stored in the register 124 in 
5 the decoder 20 is stored in the parameter storage position in the 
first memory Mc, which position is specified by the parameter 
storage position selection unit 23. 

In the decoding unit 123, every time the parameter data Dp 
is obtained as decoding data corresponding to a frame by 

10 analyzing the header of the frame, the parameter data Dp is 
transferred from the register 124 to the first memory Mc as 
described above. Further, when the parameter data Dp is referred 
to in the decoding process by the decoding unit 123 as decoding 
data, the storage position of the desired parameter data Dp in 

15 the first memory Mc is decided as described above, and the 

parameter data Dp is transferred from the first memory Mc to the 
register 124. When decoding each frame, the parameter data Dp 
corresponding to each image sequence is updated to the parameter 
data Dp corresponding to the latest frame. 

20 In the parameter storage position decision unit 22, every 

time the decoding of one frame in the decoder 20 is ended, a data 
storage region corresponding to the target image sequence to be 
decoded is selected on the basis of the image sequence 
identifying information Id which indicates the image sequence 

25 corresponding to the target frame . 
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As described above, the image decoding apparatus 2 
according to the second embodiment is provided with the decoder 
20 which includes the register 124 for storing parameter data Dp 
j that is obtained by analysis of the header of a frame or 

5 parameter data Dp to be required for decoding, and performs 

decoding of a target frame on the basis of the parameter data Dp 
stored in the register 124 ; and . Further, in the image decoding 
apparatus 2 od the second embodiment, the first memory Mc having 
has memory regions Mc (O)^-Mc (m) for storing decoding data 

10 including plural pieces of parameter data Dp corresponding to 
plural image sequences. A parameter storage position in the 
first memory Mc is specified according to the target frame, and 
the parameter data Dp is transferred between the register 120 in 
the decoder 20 and the specified parameter storage position in 

15 the first memory Mc. Therefore, even when the target image 

sequence is changed during decoding of the inputted video stream 
Vs, storage/readout of the parameter data Dp of the target image 
sequence in/from the first memory Mc can be performed by using 
the register 124, whereby parallel decoding of plural image 

20 sequences can be carried out using the single decoder 20. 

Further, since the parameter data Dp required for decoding the 
target image sequence is transferred one by one from the first 
memory Mc to the register 124 when the target image sequence is 
decoded, the number of parameter data Dp stored in the register 

25 124 in the decoder 20 is reduced, resulting in saving in the 
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capacity of the register 124, 

Further, even when the number of image sequences to be 
decoded is increased, additional memory regions can be easily 
secured by allocating memory regions for decoding data 
5 corresponding to the increased image sequences within the range 
of the capacity of the first memory Mc. 

In this second embodiment, when an absolute storage 
position AP of parameter data is derived in the parameter storage 
position decision unit 22, a target image sequence to be decoded 
ID is always decided on the basis of the image sequence identifying 
information Id. However, the method of deriving the parameter 
absolute storage position information lap is not restricted 
thereto . 

For example, when a video stream Vs of a first frame 
15 corresponding to each image sequence is inputted, the parameter 
storage position decision unit 22 may derive the parameter 
absolute storage position information lap as follows. That is, a 
target image sequence to be decoded is selected on the basis of 
the image sequence identifying information Id corresponding to 
2D the first frame, and the head position information which 

indicates the head position SA of a memory region for holding the 
decoding data corresponding to the selected image sequence is 
stored, and the parameter absolute storage position information 
lap corresponding to each parameter data Dp to be used as 
25 decoding data when a subsequent frame is decoded is derived on 
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the basis of the head position information that is stored. In 
this case, the parameter storage position decision unit 22 
decides the head position SA of the memory region only when 
the parameter storage position decision uniL 22 is given the 
5 image sequence identifying information Id of a new target image 
sequence, and updates the stored information indicating the head 
position SA of the memory region. Thereby, the computational 
complexity in the parameter storage position decision unit 22 is 
reduced. 

[ Embodiment 3 ] Third Embodiment 
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Figure 7 is a block diagram for explaining an image 
decoding apparatus 3 according to a third embodiment of the 
present invention . 

The image decoding apparatus 3 of this third embodiment 
includes, in addition to the conotitucnto constituent elements of 



the image decoding apparatus 1 of the first embodiment, an image 
data interpreting analysis unit 31 for interpreting a bit stream 
Bs inputted as image data, and separating the bit stream Bs into 
image sequence identifying information (object identifier) Id 
2D according to the first embodiment and image data (video stream) 
Vs other than the object identifier IdT — and the . The image data 
interpreting unit 31 outputs the object identifier Id ie— 
outputtod to the memory region selection unit 12 and to the 
decoding data transfer unit 13 while , and outputs the video 
25 stream Vs io outputtod to the decoder 10. Accordingly, in the 
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image decoding apparatus 3 of this third embodiment, in contrast 
with the image decoding apparatus 1 of the first embodiment, 
selection of a target image sequence to be decoded is carried out 
according to the inputted bit stream Rs . 
5 Figure 9 is a diagram illustrating the data structure of 

the bit stream Bs inputted to the image decoding apparatus 3. 

The bit stream Bs is divided into predetermined processing 
units, and unit data corresponding to each processing unit is 
composed of an object identifier Id and other image information 
10 (video stream) Vs. For example, when the bit stream Bs 

corresponds to MPEG4 coding scheme which enables coding or 
handling of an image signal corresponding to one scene for every 
object (image sequence) as one of components of the scene, the 
above-mentioned processing unit corresponds to one frame as one 
15 of the components of each object (hereinafter, referred to as a 
VOP (Video Object Plane)). 

More specifically, as shown in figure 9, the bit stream Bs 
corresponding to MPEG4 includes unit data VDO, VDl, and VD2 
corresponding to VOP(O), VOP(l), and VOP (2), respectively , and 
2) ^:her . The respective unit data VDO, VDl, and VD2 are composed of 
image data (VOP data) VO, VI, and V2 which are obtained by coding 
digital image signals corresponding to the respective VOPs, and 
object identifiers HO, HI, and H2 which are added to the 
respective image data. The image data (VOP data) VO, VI, and V2 
25 include VOP headers VhO, Vhl, and Vh2 which are data to be 
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required when decoding the VOP(O), VOP(l), and V0P(2), 

respectively. The object identifiers H0^-H2 added to the 
respective VOP data show the objects {image sequences) including 
the respective VOP data. The video stream Vs employed in the 
5 first embodiment comprises the image data including the VOP 

headers corresponding to the respective objects, other than the 
object identifier H0^-H2 . The header information of the video 
stream Vs corresponds to the VOP headers Vh0^-Vh2 . 

Other constituent-s- elements of the image decoding apparatus 
ID 3 of this third embodiment are identical to those of the image 
decoding apparatus 1 of the first embodiment. 

Hereinafter, the construction of the image decoding 
apparatus 3 will be described briefly. 

The image decoding apparatus 3 includes a decoder 10, a 
15 first memory Ma, and a second memory 14. The decoder 10 receives 
the video stream Vs supplied from the image data interpreting 
unit 31, extracts parameter data Dp (decoding data) on the basis 
of the header data (VOP headers) of the respective VOPs, and 
performs decoding on the VOP data by referring to already- 
2) processed VOP data as necessary. The first memory Ma has 
decoding data storage regions (memory regions) Ma(0), Ma(l), 
Ma(m) corresponding to plural objects (image sequences) ObO, 
Obi, Obm to be simultaneously decoded, respectively, and 

stores desired decoding data DdO, Ddl, Ddm in the respective 

25 memory regions. The second memory 14 holds already-processed VOP 
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data to be referred to in the above-mentioned decoding process, 
as reference image data Dr. 

The image decoding apparatus 3 further includes a decoding 
data transfer unit 13, and a memory region selection unit 12. 
5 The decoding data transfer unit 13 transfers the decoding data Dp 
corresponding to each object between the first memory Ma and the 
decoder 10 on the basis of the object identifier Id. The memory 
region selection unit 12 is placed between the decoding data 
transfer unit 13 and the first memory Ma, and the memory region 
10 selection unit 12 selects one of the memory regions Ma (O)-^-Ma (m) 
in the first memory Ma on the basis of the object identifier Id 
to enable access to the decoding data between the selected memory 
region and the decoding data transfer unit 13. 

The memory region selection unit 12 is identical in 
15 construction to that of the first embodiment. Further, the 
decoding data transfer unit 13 is different from that of the 
first embodiment only in that jrfe — the decoding data transfer unit 
13 of the third embodiment transfers decoding data Dd from the 
decoding data storage register 101 of the decoder 10 to the first 
20 memory Ma according to , not q timing signal It, but the object 
identifier Id , instead of a timing signal It . 

The decoder 10 comprises a decoding unit 103, a decoding 
data storage register 101, and a parameter selector 102, as in 
the case of the image decoding apparatus 1 of the first 
25 embodiment. The decoding unit 103 extracts decoding data Dd 
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corresponding to a target VOP data to be decoded, and generates 
an object identifier Id corresponding to the target VOP data. 
The decoding data storage register 101 holds the decoding data Dd 
extracted by the decoding unit 103 or the decoding data Dd which 
5 will be required in the decoding process . The parameter selector 
102 is placed between the decoding unit 103 and the decoding data 
storage register 101. Further, the decoding unit 103 is 
different from that of the first embodiment only in that jr ^the 
decoding unit 103 of the third embodiment does not output a 
ID timing signal It. 

Next, the operation of the image decoding apparatus 3 of 
this third embodiment will be described. 

The operation of the image decoding apparatus 3 is 
identical to the operation of the image decoding apparatus 1 of 
15 the first embodiment except for the operation of the image data 
interpreting unit 31_^ and— therefore, the operation relating to 
the image data interpreting unit 31 will be mainly described 
hereinafter. 

When unit data corresponding to each VOP is sequentially 
2D inputted as a bit stream Bs to the image decoding apparatus 3, 
the image data interpreting unit 31 interprets the bit stream Bs 
corresponding to the unit data of the inputted VOP, and separates 
the unit data into an object identifier Id for identifying an 
object to be processed and other image information (video stream) 
25 Vs. The object identifier Id is outputted to the memory region 
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selection unit 12 and to the decoding data transfer unit 13, and 
the video stream Vs is outputted to the decoder 10. 

Next, the memory region selection unit 12 selects a target 
object to be decoded, on the basis of the object identifier Id 
outputted from the image data interpreting unit 31, and the 
decoding data transfer unit 13 transfers decoding data Dd 
corresponding to the target object from the first memory Ma to 
the decoding data storage register 101 in the decoder 10, 

Further, in the decoder 10, the decoding unit 103 performs 
10 decoding on the VOP data with reference to the decoding data Dd 
stored in the decoding data storage register 101. 

When decoding of the inputted VOP data is completed and the 
image data interpreting unit 31 detects an object identifier Id 
corresponding to the next VOP data, the decoding data transfer 
15 unit 13 transfers the decoding data Dd stored in the decoding 

data storage register 101, to a memory region in the first memory 
Ma, which is selected at this point of time by the memory region 
selection unit 12. 

When this transfer is completed, the memory region 
20 selection unit 12 selects a memory region in the first memory Ma, 
which corresponds to the target object to be decoded, on the 
basis of the object identifier Id corresponding to the next VOP, 
and thereafter, decoding of this VOP data is carried out in the 
same manner as described above. 
25 In this way, decoding of each VOP which is sequentially 
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inputted as a bit stream Bs is repeated on the basis of the unit 
data corresponding to each VOP, and the decoded image data Db 
corresponding to each VOP is generated. 

As described above, the image decoding apparatus 3 of this 

5 third embodiment is provided with, in addition to the 

constituents- elements of the image decoding apparatus 1 of the 
first embodiment, the image data interpreting unit 31 which 
interprets a bit stream Bs inputted as unit data corresponding to 
each VOP, separates the unit data into an object identifier Id 

10 for identifying an object to be processed and image information 
(video stream) Vs other than the object identifier Id, and 
outputs the object identifier Id to the memory region selection 
unit 12 and to the decoding data transfer unit 13 while 
outputting the video stream Vs to the decoder 10, Therefore, in 

15 addition to the effects obtained by the first embodiment, a 
target object to be decoded can be selected according to a bit 
stream Bs which is inputted as unit data corresponding to each 
VOP. 

Furthermore, the decoder 10 is provided with the decoding 
20 data storage register 101 for holding the decoding data Dd to be 
referred to in the decoding process, and the decoding data Dd 
corresponding to each object is transferred between the decoding 
data storage register 101 and the first memory Ma which holds the 
decoding data Dd corresponding to all objects to be decoded. 
25 Therefore, the process of decoding the respective VOP data on the 
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basis of the decoding data Dd corresponding to the respective 
target objects can be carried out by using the single decoder 10. 
Further, when the decoding data storage register 101 is 
constituted by a quick access storage such as a cache or a SPxAM, 
the performance of the image decoding apparatus 3 can be enhanced. 

Furthermore, even when the number of target objects Ob 
included in the bit stream Bs is increased, additional memory 
regions for holding the decoding data Dd corresponding to the 
increased objects can be easily provided by allocating the memory 
regions on the memory space of the first memory Ma within the 
capacity of the first memory Ma. 

Furthermore, the plural parameter data Dp constituting the 
decoding data Dd are transferred between the decoding data 
storage register 101 where the storage positions for the 
respective parameters are set, and the memory regions in the 
first memory Ma where the storage positions for the respective 
parameters are set. Therefore, even when the target object to be 
decoded is changed during the decoding process by the decoding 
unit 103, the parameter storage positions in the respective 
decoding data storage regions (memory regions) in the first 
memory Ma are not changed. Consequently, the computational 
complexity relating to the parameter storage position when the 
target object is changed can be reduced. 

While in thio third ombodimcnt the decoder 10 in the third 
embodiment is provided with the decoding data storage register 
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in which wherein the decoding data Dd corresponding to the 
target object to be decoded is stored^ the construction of the 
decoder 10 is not restricted thereto. When the first memory Ma 
has a temporary memory region wherein in which the decoding data 
Dd corresponding to the target object is temporarily stored, the 
decoder 10 may be provided with a register wherein only part of 
all parameter data Dp corresponding to the target object is 
stored, and the decoding data may be transferred in parameter 
units between the register and the temporary memory region. 
[Embodiment <j] Fourth Embodiment 

Figure 8 is a block diagram illustrating an image decoding 
apparatus 4 according to a fourth embodiment of the present 
invention . 

The image decoding apparatus 4 according to the fourth 
embodiment includes, in addition to the constituent-s - elements of 
the image decoding apparatus 2 of the second embodiment, an image 
data interpreting (analysis) unit 41 for interpreting a bit 
stream Bs inputted as image data, and separating the bit stream 
Bs into image sequence identifying information (object 
identifier) Id according to the second embodiment and image data 
(video stream) Vs other than the object identifier Id , and . The 
image data interpreting unit 41 putputs the object identifier Id 
is outputtcd to the parameter storage position decision unit 22, 
and outputs vjhilc the video stream Vs io outputtcd to the decoder 
20. Accordingly, in the image decoding apparatus 4 of this 



fourth embodiment, in contrast with the image decoding apparatus 
2 of the second embodiment, selection of a target object to be 
decoded is carried out according to the inputted bit stream Bs . 
Further, the data structure of the bit stream Bs inputted 
5 to the image decoding apparatus 4 is identical to that of the bit 
stream Bs inputted to the image decoding apparatus 3 of the third 
embodiment . 

Other constituent-s - elements of the image decoding apparatus 
4 according to this fourth embodiment are identical to those of 

10 the image decoding apparatus 2 according to the second embodiment. 
Hereinafter, the construction of the image decoding 
apparatus 4 will be described. 

The image decoding apparatus 4 includes a decoder 20, a 
first memory Mc, and a second memory 14. The decoder 20 receives 

15 a video stream Vs supplied from the image data interpreting unit 
41, extracts parameter data Dp (decoding data) on the basis of 
header information (VOP header) of each VOP, and performs 
decoding on the VOP data by referring to already-processed VOP 
data as necessary. The first memory Mc has memory regions 

20 (decoding data storage regions) lyic(O), Mc(l), Mc (m) 

corresponding to plural objects to be simultaneously decoded, 
respectively, and stores desired decoding data DdO, Ddl, Ddm 
in the respective memory regions. The second memory 14 holds 
already-processed VOP data to be referred to in the above- 

25 mentioned decoding process, as reference image data Dr. 
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The decoder 20 comprises a decoding unit 123, and a 
register 124. The decoding unit 123 extracts various kinds of 
parameter data Dp as decoding data corresponding to a target VOP 
to be decoded by analyzing header information (VOP header) of the 

5 inputted video stream Vs, and generates parameter relative 

storage position information Irp for identifying the parameter 
data Dp. The register 124 holds the parameter data Dp 
corresponding to the target VOP, which is supplied from the 
decoding unit 123. 

10 Further, the image decoding apparatus 4 includes a 

parameter storage position decision unit 22, and a parameter 
storage position selection unit 23. The parameter storage 
position decision unit 22 decides an absolute storage position AP 
for the parameter data on the basis of the image sequence 

15 identifying information Id corresponding to each object and the 
parameter relative storage position information Irp supplied from 
the decoding unit 123 in the decoder 20, and outputs parameter 
absolute storage position information lap indicating the absolute 
storage position. The parameter storage position selection unit 

20 23, which is placed between the decoder 20 and the first memory 
Mc, selects a parameter storage position in a memory region in 
the first memory Mc on the basis of the parameter absolute 
storage position information lap to enable access to the 
parameter data Dp between the selected parameter storage position 

25 and the register 124 of the decoder 20. 
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Next, the operation of the image decoding apparatus 4 
constructed as described above will be described. 

The operation of the image decoding apparatus 4 is 
identical to that of the image decoding apparatus 2 of the second 
embodiment except for the operation of the image data 
interpreting unit 41^ and— therefore, the operation of the image 
data interpreting unit 41 will be mainly described hereinafter. 

When unit data corresponding to each VOP is sequentially 
inputted as a bit stream Bs to the image decoding apparatus 4, 
10 the image data interpreting unit 41 interprets the unit data 
corresponding to the inputted VOP, and separates the unit data 
into an object identifier Id for identifying an object to be 
processed and other image data (video stream) Vs. The object 
identifier Id is outputted to the parameter storage position 
15 decision unit 22, and the video stream Vs is outputted to the 
decoder 20. 

In the decoder 20, the decoding unit 123 performs decoding 
on the target VOP. In this decoding process, initially, the 
header of the target VOP (VOP header) is analyzed to obtain 

20 parameter data Dp which is required for the VOP data decoding 

process, and a relative storage position RP of the parameter data 
Dp indicating the kind of each parameter is generated as 
parameter relative storage position information Irp. The 
parameter data Dp obtained as decoding data in the decoding 

25 process is stored in the register 124 in the decoder 20. Further, 
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the parameter relative storage position information Irp is 
outputted to the parameter storage position decision unit 22. 

In the parameter storage position decision unit 22, a 
parameter storage position in the first memory Mc is decided on 

5 the basis of the parameter relative storage position information 
Irp supplied from the decoding unit 123 and the object identifier 
Id supplied from the image data interpreting unit 41, and the 
parameter data Dp obtained in the decoding unit 123 is 
transferred to the decided parameter storage position. That is, 

10 the obtained parameter data Dp corresponding to the target VOP is 
stored in a memory region in the first memory Mc, which memory 
region corresponds to an object including the target VOP. 

The storage position in the first memory Mc, where the 
parameter data Dp obtained in the decoding unit 123 is to be 

15 stored, is decided by the parameter storage position decision 

unit 22 in the same manner as described for the second embodiment. 

On the other hand, in the case where the parameter data Dp 
as decoding data is referred to when the video stream Vs is 
decoded by the decoding unit 123, the parameter storage position 

2Q is decided in the same manner as described above, and parameter 
data Dp stored in the decided position is transferred from the 
first memory Mc to the register 124. Then, decoding of the video 
stream Vs is carried out on the basis of the parameter data Dp 
stored in the register 124. When transferring the parameter data 

25 Dp between the first memory Mc and the register 124, the 
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parameter storage position selection unit 23 selects one of the 
plural parameter storage positions in the first memory Mc by the 
same operation as described for the parameter storage position 
selection unit 23 according to the second embodiment. 

5 When a bit stream (unit data) Bs corresponding to the next 

VOP is inputted, the image data interpreting unit 41 detects an 
object identifier Id corresponding to this VOP, and the parameter 
data Dp is transferred between the register 124 and the first 
memory Mc on the basis of the object identifier Id, and decoding 

10 of the video stream (VOP data) corresponding to this VOP is 

carried out on the basis of the parameter data Dp stored in the 
register 124. 

In this way, decoding of each VOP, which is sequentially 
inputted as a bit stream Bs, is repeated on the basis of the unit 

15 data corresponding to each VOP, whereby the decoded image data Db 
corresponding to each VOP is generated. 

As described above, the image decoding apparatus 4 
according to this fourth embodiment is provided with, in addition 
to the constituent-5- elements of the image decoding apparatus 2 of 

20 the second embodiment, the image data interpreting unit 41 which 
interprets a bit stream Bs inputted as unit data corresponding to 
each VOP, separates the bit stream Bs into an object identifier 
Id for identifying a target object to be decoded and other image 
data (video stream) Vs, and outputs the object identifier Id to 

25 the parameter storage position decision unit 22 while outputting 
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the video stream Vs to the decoder 20. Therefore, in addition to 
the effects of the second embodiment, selection of a target 
object to be decoded can be carried out according to a bit stream 
Bs which is inputted as unit data corresponding to each VOP. 
5 Furthermore, as in the second embodiment, the decoder 20 of 

this fourth embodiment is provided with the register 124 for 
holding parameter data Dp to be referred to as decoding data in 
the decoding process, and the parameter data Dp corresponding to 
each object is transferred between the register 124 and the first 

10 memory Mc which holds the decoding data Dd corresponding to all 
objects to be decoded. Therefore, even when the target object is 
changed during the process of decoding the video stream Vs, 
storage and readout of the parameter data of the target object 
can be carried out by using the register 124, whereby decoding 

15 processes for plural objects can be carried out in parallel, 
using a single decoder. 

Moreover, even when the number of target objects is 
increased, additional memory regions for decoding data of the 
increased objects can be easily provided by assigning the memory 

2) regions on the memory space of the first memory Mc within the 
range of the capacity of the first memory Mc. 

While in thio fourth ombodimont a target object to be 
decoded is decided in this fourth embodiment on the basis of the 
object identifier Id every time the parameter storage position 

25 decision unit 22 derives parameter absolute storage position 
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information lap, the method of deriving the parameter absolute 
storage position information lap is not restricted thereto. 

For example, the parameter storage position decision unit 
22 may derive the parameter absolute storage position inform.ation 
lap as follows. When a video stream of a first VOP corresponding 
to each object is inputted, a target object to be decoded is 
selected on the basis of the object identifier Id corresponding 
to the first VOP, and the header position information which 
indicates the head position SA of a memory region holding the 
decoding data corresponding to the selected object— is stored. 
Then, the parameter absolute storage position information lap 
corresponding to each parameter data Dp to be used as decoding 
data when a subsequent VOP is decoded, is derived on the basis of 
the stored header position information. In this case, the 
parameter storage position decision unit 22 decides the head 
position SA of a memory region and updates the stored information 
indicating the head position SA of the memory region, only when 
the decision unit 22 is given an object identifier Id of a new 
target of decoding. Thereby, the computational complexity in the 
parameter storage position decision unit 22 can be reduced. 

Furthermore, also in the second, third, and fourth 
embodiments, the first memory Ma (Mc) for holding the decoding 
data Dd and the second memory 14 for holding the data other than 
the decoding data Dd (e.g., data to be temporarily stored, or 
reference image data Dr) are different memories. However, the 
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first and second memories may be constituted by a single memory. 
In and; — ift this case, a region for holding the decoding data Dd 
and a region for holding the data other than the decoding data Dd 
are allocated on this single m emory. 

5 Moreover, in the third and fourth embodiments, the bit 

stream Bs inputted to the image decoding apparatus 3 or 4 is a 
bit stream in which an object identifier Id is added to every VOP 
that is a processing unit based on MPEG4 . However, the object 
identifier Id may be added to a fundamental processing unit of 

ID image data corresponding to each image sequence other than VOP, 
for example, a picture or a frame based on MPEGl or MPEG2 . 
Further, the object identifier Id may be added to every 
processing unit including a plurality of the above-mentioned 
fundamental units . 

15 An image decoding program for permitting a computer to 

perform any of the image decoding processes according to the 
aforementioned embodiments can be recorded on a data storage 
medium such as a floppy disk, whereby the image decoding process 
can easily be carried out in an individual computer system by 

20 using the program stored in the medium. 

Figures 10 (a) -10(c) are diagrams for explaining the 
execution of an image decoding process according to any of the 
aforementioned embodiments and modifications, by a computer 
system, using a floppy disk containing the above-described image 

25 decoding program. 
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Figure 10 (a) illustrates a front view of a floppy disk FD^ 
a cross-sectional view thereof, and a floppy disk body Di . 
Figure 10(b) shows an example of a physical format of the floppy 
disk body Di . 

5 The floppy disk FD is obtained by mounting the floppy disk 

body Di in a floppy disk case FC. At the surface of the floppy 
disk body Di, a plurality of tracks Tr are formed concentrically 
from the outer circumference toward the inner circumference. 
Each track Tr is divided into 16 sectors Se at equal angles. 
ID Therefore, in the floppy disk FD containing the above-mentioned 
program, data of the program is recorded in the sectors Se which 
are allocated on the floppy disk body Di . 

Figure 10(c) illustrates a system for recording the image 
decoding program in the floppy disk FD, and performing the image 
15 decoding process by software using the image decoding program 
stored in the floppy disk FD. 

When recording the image decoding program in the floppy 
disk FD, data of the image decoding program is read from a 
computer system Cs and written in the floppy disk FD through a 
20 floppy disk drive FDD. When constructing the above-mentioned 
image decoding apparatus in the computer system Cs according to 
the program recorded in the floppy disk FD, the program is read 
from the floppy disk FD by using the floppy disk drive FDD and 
then loaded onto the computer system Cs. 
25 Although in figuroo 10(a) — 10(c) a floppy disk is shown in 
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figures 10(a)-10(c) as an example of the program storage medium, 
an optical disk may be employed as the program storage medium. 
Also_^ in this case, an image decoding process according to any of 
the aforementioned embodiments can be executed by software in the 

5 same manner as described for the floppy disk. Furthermore, the 
program storage medium is not restricted to the optical disk or 
floppy disk, and any disk, such as an IC card or a ROM cassette, 
may be employed so long as the program can be recorded on it. 
Also^ in the case of using these mediums, an image decoding 

ID process according to any of the aforementioned embodiments can be 
executed by software in the same manner as described for the 
floppy disk. 
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ABSTRACT OF THE DISCLOSURE 



An image decoding apparatus GomprioGO includes a decoder 
having a decoding data storage register for holding decoding data 
5 corresponding to a target VOP to be decoded, and decoding a video 
stream corresponding to the target VOP on the basis of the 
decoding data stored in the register-T — aB^ . The image decoding 
apparatus also includes a first memory having plural storage 
regions for holding decoding data corresponding to plural objects 
10 whoroin the . The decoding data are transferred between the 
decoding data storage register in the decoder and a specific 
storage region in the first memory. Therefore, it is possible to 
perform decoding on a video stream comprioing including plural 
objects by using a single decoder. Further, even when the number 
15 of objects to be decoded is increased, storage regions for 

decoding data corresponding to the increased objects can easily 
be increased. 



72 



